PATENT ABSTRACTS OF JAPAN 

( ! 1 Publication number : 2000-059666 
(43)Date of publication of application : 25.02.2000 

(SDlntCL H04N 5/225 

H04N 5/64 
H04N 9/04 



(21) Application number : 10-224915 (71)Appiicant : VICTOR CO OF JAPAN LTD 

(22) Date of filing : 07.08.1998 (72)Inventor : KONO KEIZO 

ISHIZAK1 KOICHI 
YAMADA YUKITO 



(54) IMAGE PICKUP DEVICE 



(57)Abstract 

PROBLEM TO BE SOLVED: To reduce fatigue to user of 
a head-mount display by making more speedy and 
comfortable the change in an image pickup direction 
concerning a head-mount display image pickup device. 
SOLUTION: A head-mount display 100 is composed of a 
CCD camera 3 (image pickup means) for picking up the 
image in a visual range 2 of a user 1 mounting the 
display, a display device 5 (image display means) for 
forming the image picked up by this CCD camera 3 on 
the retina 4a of the user 1 of the display, a detecting 
means 6 for detecting a glance direction 2 of the user 1 
of the display, and a drive means 7 for making the image 
pickup direction of the CCD camera 3 follow the glance 
direction 2 detected by the detecting means 6. 
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NOVELTY - A detector (6) and drive unit (7) are held nearer to 
person's pupil (4). The detector detects eye direction of person (1) 
following which drive unit drives camera (3) to track in the detected 
eye direction. The camera photographs the person's visual field area 
(2) while a display unit (5) makes photographed image to form on 
person's retina (4a). 

USE - For visually handicapped. 

ADVANTAGE - The turnover of image pick-up direction is made quicker 
and comfortable by incorporating the eye direction detector and 
corresponding camera drive unit. 

DESCRIPTION OF DRAWING (S) - The figure shows the top view of head 
mount display. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] the image pick-up means of picturizing a covering person's visual field field, 
an image-display means carry out the image formation of the image picturized by this 
image pick-up means on said covering person's retina, a detection means detect 
said covering person's direction of a look, and the driving means that make the 
image pick-up direction of said image pick-up means follow in said direction of a look 
detected by said detection means -- since - the image pick-up equipment 
characterized by to become. 

[Claim 2] Image pick-up equipment characterized by having a maintenance means to 
hold said image pick-up means, said image display means, said detection means, 
and said driving means near said covering person's eyeball in one, in image pick-up 
equipment according to claim 1. 

[Claim 3] It is image pick-up equipment characterized by having an image core 
migration means to move the core of an image that said image display means was 
picturized by said image pick-up means in image pick-up equipment according to 
claim 1 or 2 in a covering person's direction of a look. 

[Claim 4] Image pick-up equipment characterized by having an assignment means to 
specify the photographic subject displayed on said image display means in image 
pick-up equipment according to claim 1 , 2, or 3, and a notice means of a color to tell 
the color of this photographic subject specified by this assignment means. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention picturizes the visual field range of a covering 
person, relates to the image pick-up equipment constituted so that image formation 
of the image might be carried out on a covering person's retina, and relates to the 
head mount display with which it equips in order to amend visual disturbance, such 
as dysopsia and color amblyopia, especially. 
[0002] 

[Description of the Prior Art] The head mount display format is developed as 
equipment which amends visual disturbance, such as the former, for example, the 
dysopsia, and color amblyopia. Drawing 12 is the top view showing the head mount 
display 1 10 for the conventional visual disturbance amendment. 
[0003] A head mount display 110 consists of CCD camera 113 which picturizes the 
covering person's 111 visual field field 1 12, a finder 1 15 which carries out image 
formation of the image picturized by this CCD camera 1 13 on the covering person's 
111 retina 1 14, and a body 1 16 for fixing each of these equipments to the covering 
person's 1 1 1 head in one in this drawing. 

[0004] If it explains in full detail, CCD camera 113 picturizes the field 117 equivalent 
to the covering person's 111 visual field field 112, and after being amended, it will 
project with a color LCD 118, it will be reflected by the mirror 119, and it will project 
the picturized image on the finder 1 15 by which opposite arrangement was carried 
out at the covering person's 111 retina 114. 
[0005] 

[Problem(s) to be Solved by the Invention] However, in the conventional head mount 
display 110 mentioned above, since CCD camera 1 13 is being fixed to the 
transverse-plane location of a body 116, the image pick-up direction of this CCD 
camera 113 always serves as only a transverse plane of a body 116. 
[0006] Therefore, when it is going to change the image pick-up direction by CCD 
camera 113, CCD camera 113 must turn to the covering person 111 the whole body 
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1 16 by turning a self head in the direction which desires an image pick-up, and he 
has to convert, and fatigue at the time of wearing of a head mount display 1 10 is 
large, and he has **** to which practicality falls while conversion of the momentary 
image pick-up direction is difficult. 

[0007] Then, this invention is accomplished in view of the above-mentioned situation, 
and makes it a technical problem for the purpose to make conversion of the image 
pick-up direction in the image pick-up equipment of a head mount display format 
quicker and comfortable. 
[0008] 

[Means for Solving the Problem] In order to attain the above-mentioned technical 
problem, invention concerning this application claim 1 becomes from an image pick- 
up means picturize a covering person's visual field field, an image-display means 
carry out the image formation of the image picturized by this image pick-up means 
on said covering person's retina, a detection means detect said covering person's 
direction of a look, and the driving means that make the image pick-up direction of 
said image pick-up means follow in said direction of a look detected by said detection 
means. 

[0009] Since according to invention concerning such a claim 1 a covering person's 
direction of a look is detected and the image pick-up direction of an image pick-up 
means is made to follow in the direction of a look, even if a covering person does not 
change the direction of the whole equipment, he can project on an image display 
means the direction for which it asks. 

[0010] Invention concerning claim 2 has a maintenance means to hold said image 
pick-up means, said image display means, said detection means, and said driving 
means near said covering person's eyeball in one, in invention concerning claim 1. 
[0011] Since it can equip with each means to constitute image pick-up equipment, in 
one according to invention concerning such a claim 2, the attachment and 
detachment become easy. 

[0012] Invention concerning claim 3 has an image core migration means to move the 
core of an image that said image display means was picturized by said image pick- 
up means in a covering person's direction of a look, in image pick-up equipment 
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according to claim 1 or 2. 

[0013] When according to invention concerning such a claim 3 it follows in a covering 
person's direction of a look and the image pick-up direction of an image pick-up 
means is changed by moving the core of the image displayed by the image display 
means in a covering person's direction of a look, it can prevent a gap arising in the 
object which the covering person is observing, and the object displayed on an image 
display means. 

[0014] Invention concerning claim 4 has an assignment means to specify the 
photographic subject displayed on said image display means, and a notice means of 
a color to tell the color of this photographic subject specified by this assignment 
means, in image pick-up equipment according to claim 1, 2, or 3. 
[0015] According to invention concerning such a claim 4, even if a covering person 
has visual disturbance, such as color amblyopia, the color of the picturized object 
can be recognized easily. 
[0016] 

[Embodiment of the Invention] The 1st operation gestalt of this invention is explained 
below to the 1st operation gestalt at a detail. Drawing 1 shows typically the internal 
configuration of the head mount display 100 in this operation gestalt, and drawing 2 
R> 2 and drawing 3 are the perspective views showing the appearance. 
[0017] In drawing 1 thru/or drawing 3 a head mount display 100 CCD cameras 3 and 
3 which picturize the covering person's 1 visual field field 2, and the display units 5 
and 5 which carry out image formation of the image picturized by these CCD 
cameras 3 and 3 on the covering person's 1 retina 4a, It consists of detection means 
6 and 6 to detect the covering person's 1 direction of a look, and driving means 7 
and 7 which make the image pick-up direction of CCD cameras 3 and 3 follow in the 
direction of a look detected by the detection means 6 and 6. In addition, in this 
operation gestalt, these means operate according to the power source supplied from 
a power unit 9. 

[0018] CCD cameras 3 and 3 are image pick-up means to have an image pick-up 
field almost equal to the covering person's 1 visual field fields 2 and 2, and driving 
means 7 and 7 convert the image pick-up direction vertically and horizontally. And 
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with this operation gestalt, these CCD cameras 3 and 3 are covered with hood 3a of 
the shape of a transparent semi-sphere while they are formed in the two front 
sections of a body 8. Moreover, the spacing is set up almost equally to spacing of 
the covering person's 1 eyeballs 4 and 4, and these two CCD cameras 3 and 3 are 
arranged so that the direction of a look and the image pick-up direction of the 
covering person 1 may be in agreement. In addition, a spacing adjustment means 
may be formed in CCD cameras 3 and 3 in order to make spacing of the covering 
person's 1 eyeballs 4 and 4 suit about spacing of these CCD cameras 3 and 3. 
[0019] Display units 5 and 5 consist of a finder 57 arranged so that the back light 51 , 
the color LCD 52 and focus control 53 which were built in the flank of a body 8, the 
reflecting mirror 54 arranged on the optical axis of a focus 53, a lens 56 and a 
reflecting mirror 55, and the covering person's 1 eyeball 4 may be countered. 
[0020] By these display units 5 and 5, the image picturized with CCD camera 3 is 
displayed on a finder 57 through a reflecting mirror 54, a lens 56, and a reflecting 
mirror 55, after projecting with the back light 51 and the color LCD 52 and adjusting a 
focus etc. with focus control 53. 

[0021] A well-known technique can be used as detection means 6 and 6. The thing 
of a method which used infrared radiation is adopted with this operation gestalt. 
Drawing 4 explains more the detection means 6 and 6 concerning this operation 
gestalt to a detail. 

[0022] As shown in drawing 4 (a) thru/or (c), the detection means 6 and 6 irradiate 
infrared light at an eyeball 4 from the sources 60X and 60Y of infrared light by which 
contiguity arrangement was carried out at the eyeball 4, receive the reflected light by 
optoelectric transducers 61 R, 61 L, 61 U, and 61 D, and detect migration to dark-eyed 
right and left and the dark-eyed upper and lower sides. 

[0023] If it explains in full detail, the optoelectric transducers 61 R and 61 L which 
detect the movement toward dark-eyed right and left will be arranged so that the 
reflected light from dark-eyed right-hand side and left-hand side may be received, 
respectively, after the iris of the eye has turned to the transverse plane, and the 
output will be amplified with amplifier 63. Moreover, both the optoelectric transducers 
61 U and 61 D that detect a motion of the dark-eyed vertical direction are arranged so 
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that the reflected light from the dark-eyed bottom location of slant may be received, 
after the iris of the eye has turned to the transverse plane, and the output is amplified 
with amplifier 62. And the output from amplifier 62 and 63 is analyzed by the analysis 
circuit (not shown), and the covering persons 1 direction of a look is specified. 
[0024] Driving means 7 and 7 make the upper and lower sides and right and left 
rotate CCD cameras 3 and 3 so that they may make the image pick-up direction of 
CCD cameras 3 and 3 follow in the covering person's 1 direction of a look detected 
by the above-mentioned detection means 6 and 6. The concrete configuration of 
these driving means 7 and 7 is shown in drawing 5 and drawing 6 . In addition, 
drawing 5 R> 5 is the perspective view of a driving means 7, drawing 6 (a) shows the 
idle state of a driving means 7, and this drawing (b) shows the rotation condition. 
[0025] as shown in drawing 5 and drawing 6 (a), CCD camera 3 protrudes on the 
cube-like pedestal 70 -- having -- **** this pedestal 70 -- level shaft 70a -- an inner 
flame 71 - receiving the upper and lower sides -- it is attached rotatable. Moreover, 
the motor 73 is formed in the pedestal 70, vertical rotation is carried out to an inner 
flame 71 by this, and this vertical rotation is braked by the brake mechanism 75. 
[0026] A brake mechanism 75 consists of pan spring 75c which forces on a pedestal 
70 side permanent magnet 75a which was inserted in level shaft 70a and fixed to the 
pedestal 70 side, electromagnet 75b by which opposite arrangement is carried out so 
that it may be inserted in level shaft 70a possible [ a slide ] and may oppose 
magnetically to permanent magnet 75a, and this electromagnet 75b. 
[0027] And in order to rotate a pedestal 70 up and down, energize to electromagnet 
75b and this is made to repel magnetically to permanent magnet 75a, electromagnet 
75b is made to isolate from permanent magnet 75a, a brake is taken off, and it is 
made to rotate by the motor 73, as shown in drawing 6 (b). If the energization to 
electromagnet 75b is disconnected, magnetic repulsion will be lost, electromagnet 
75b is forced on permanent magnet 75a by the elastic force of pan spring 75c, and 
rotation of a pedestal 70 is braked. 

[0028] moreover, the inner flame 71 - a pedestal 70 - the same - perpendicular 
shaft 71a - an outer flame 72 receiving -- right and left - it is attached rotatable. 
Furthermore, the motor 74 is formed also in this inner flame 71 , and thereby, while 
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rotating an inner flame 71 right and left to an outer flame 72, that rotation is 
controlled by the brake mechanism 75 and the brake mechanism 76 equipped with 
the same configuration. 

[0029] Moreover, with this operation gestalt, these CCD cameras 3 and 3, display 
units 5 and 5, the detection means 6 and 6, and driving means 7 and 7 are held near 
the covering person's 1 eyeball 4 in one at the body 8. 

[0030] In order to hold this on the covering person's 1 head, the fixed belts 81 and 83 
are formed in this body 8. The fixed belt 81 fixes a body 8 in the covering person's 1 
upper head, and the fixed belt 83 fixes a body 8 in the covering person's 1 regio 
occipitalis capitis. Moreover, the dial-type adjusters 81a and 83a which perform 
bolting adjustment of this are formed in these fixed belts 81 and 83. 
[0031] Since according to the head mount display 100 concerning such this 
operation gestalt the covering person's 1 direction of a look can be detected and the 
image pick-up direction of CCD cameras 3 and 3 can be made to follow in the 
direction of a look, even if the covering person 1 does not change the direction of the 
whole equipment, he can project on a display unit 5 the direction for which it asks. 
[0032] Moreover, with this operation gestalt, since [ which makes almost equal 
spacing of CCD cameras 3 and 3, and spacing of the covering person's 1 eyeballs 4 
and 4 ] it was prepared, it should be more rich in the sense of reality in the image 
displayed by display units 5 and 5. 

[0033] Furthermore, with this operation gestalt, in order to attach in a body 8 in one 
each means to constitute a head mount display device 100, attachment and 
detachment of this become easy. 

[0034] The 2nd operation gestalt of this invention is explained below to the 2nd 
operation gestalt at a detail. With this operation gestalt, the means of displaying of 
the image projected on the display unit 5 in the 1st operation gestalt mentioned 
above is explained in full detail. In addition, the configuration of the whole head 
mount display concerning this 2nd operation gestalt is the same as that of the head 
mount display 100 in the 1st operation gestalt mentioned above. 
[0035] And especially the display unit concerning this 2nd operation gestalt has an 
image core migration means (not shown) to move the core of the image picturized by 
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CCD cameras 3 and 3 in the covering person's 1 direction of a look. 
[0036] This image core migration means is an operation means to process the image 
projected on a display unit 5 in this operation gestalt, and CPU built in a body 8 can 
realize this operation means. 

[0037] Processing of the image by this image core migration means is explained with 
reference to drawing 7 below. In addition, drawing 7 shows the image pick-up image 
by CCD camera 3, and the display image by the display unit 5. 
[0038] Now, as shown in drawing 7 (a), CCD camera 3 has caught the cylinder 701 
in this side at the core of an image. As shown in drawing 7 (b), while the cylinder 701 
has projected on the finder 57 of a display unit 5 at the core at this time, the covering 
person 1 is observing the core P1 of a finder 57. 

[0039] And as shown in this drawing (b), suppose that the direction of a look was 
moved to P2 that the covering person 1 should observe the cube 702 which is back. 
Then, the detection means 6 detects change of a covering person's direction of a 
look, and changes the image pick-up direction of CCD camera 3 by the driving 
means 7. 

[0040] Change of the image pick-up direction of CCD camera 3 catches a cube 702 
at the core of CCD camera 3, as shown in drawing 7 (c). According to this, as shown 
in drawing 7 (d), in a finder 57, a cube 702 will project on the core P1 of an image, 
and a gap will arise from P2 which the covering person is observing. 
[0041] Under the present circumstances, an image core migration means processes 
the image which computes and displays the variation rate from the core P1 of a 
display image to the attention part P2. That is, as shown in drawing 7 (e), the core 
P1 of a display image is moved to the location of P2, and it is made in agreement 
with P2 location where a covering person observes the object which CCD camera 3 
has caught at the core. 

[0042] In addition, although the order to which the core of a display image is moved 
that this should be amended explained after the gap arose between P1 and P2 for 
convenience in this operation gestalt If a display image is processed into detecting 
change of the covering person's 1 direction of a look, and changing the image pick- 
up direction, and coincidence and the core of a display image is moved [ the drive of 
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a driving means 7 ] A display object can be smoothly projected in a covering 
person's direction of a look, and it can avoid giving the covering person 1 displeasure. 
[0043] In order to move the core P1 of the image displayed on a display unit 5 in a 
covering person's direction P2 of a look according to the head mount display 
concerning the 2nd [ this ] operation gestalt which has such an image core migration 
means, when it follows in a covering person's direction of a look and the image pick- 
up direction of CCD camera 3 changes, it can prevent a gap arising between the 
objects displayed on the point which the covering person notes, and an image- 
display means. 

[0044] In addition, in this operation gestalt, as a migration means based on images, 
although the image was processed with the operation means, this invention is not 
limited to this. For example, consider the finder 57 of a display unit 5 as a movable 
configuration vertically and horizontally, it is made to follow in a covering person's 
direction of a look, and the location of a finder 57 may be made to change. 
[0045] Moreover, the display units 5 and 5 concerning this 2nd operation gestalt 
have an image amendment means to emphasize and display the profile of the 
picturized photographic subject. This image amendment means is realizable with 
arithmetic units, such as CPU which it had for example, in the body 8. 
[0046] What emphasizes the profile of a photographic subject is employable by 
emphasizing the contrast of the image picturized, for example with CCD camera 3 as 
a method of this image amendment, reversing a hue, or extracting the profile of a 
photographic subject. 

[0047] in addition, as an approach of extracting the profile of a photographic subject 
for example, the thing for which the difference of the newly picturized image and the 
image picturized before the predetermined period (for example, one-frame period) is 
taken -- or By memorizing the background image beforehand and taking the 
difference of this and an input image, a part with the motion in an image can be 
specified and the approach of processing noise rejection, labeling, a feature 
extraction, etc. to this can be used. 

[0048] Furthermore, the head mount display concerning this 2nd operation gestalt is 
equipped with a notice means of a color to tell the color of the photographic subject 
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projected on the display unit 5. It notifies the analyzed color by displaying an 
alphabetic character etc. on the display means 5 like "RED" while this notice means 
of a color detects the covering person's 1 direction P3 of a look with the detection 
means 6, specifies the photographic subject 801 which the covering person 1 is 
observing and specifically analyzes that color, as shown in drawing 8 (a). 
[0049] In addition, as an approach of notifying a covering person of this color, it 
displays in an alphabetic character etc. as mentioned above, and also the 
loudspeaker (not shown) built into the body 8, for example can also notify with voice. 
[0050] Moreover, although assignment of a photographic subject that he wanted to 
identify a color was performed with this operation gestalt by detecting a covering 
person's direction of a look with the detection means 6, this invention is not limited to 
this and can also be manually specified using pointer equipment 90 as shown in 
drawing 8 (b). 

[0051] That is, by [ to which it pinches and 91 is moved vertically and horizontally ] 
having been prepared, for example in the upper part of the grip 93 of pointer 
equipment 90, the point P3 projected on the finder 57 of a display unit 5 is moved on 
the photographic subject 801 of arbitration, by pushing a switch 92, the point P3 is 
locked, the color of the photographic subject is analyzed, and an alphabetic 
character, voice, etc. can notify a color. 

[0052] As an example for realizing such a function, a circuit block as shown in 
drawing 9 is explained. 

[0053] After separating the color of the output from CCD camera 3 as an image pick- 
up means three times, each signal of R, G, and B which were changed into the 
digital signal with A/D converters 94, 94, and 94 is supplied to level circuits 95, 95, 
and 95, respectively. And by supplying a control section 96, each signal level is 
compared and the output of level circuits 95, 95, and 95 can recognize the color 
information on a photographic subject with voice by making the result pronounce 
from a loudspeaker 99 through amplifier 98 through an electronic speech circuit 97 if 
needed. Moreover, it is also possible to also pronounce information, such as a 
condition of a photographic subject, suitably. 

[0054] After the output from a control section 96 is changed into a predetermined 
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character code by the character code transducer 100 for outputting the recognized 
color information as text as text information on the other hand, it is changed into a 
predetermined pattern alphabetic character by the transducer 101, and is outputted 
to a display unit 5. 

[0055] According to the head mount display device equipped with such a notice 
means of a color, the failure is suppliable even if a covering person has visual 
disturbance, such as color amblyopia. 

[0056] The 3rd operation gestalt, next the 3rd operation gestalt of this invention are 
explained with reference to drawing 10 . As shown in this drawing, the head mount 
display 200 concerning this operation gestalt forms the 3rd image pick-up means 201 
in the anterior part of the body 8 in the head mount display 100 in the 1st operation 
gestalt mentioned above. 

[0057] The wide angle camera which can photo a large area rather than CCD 
camera 3 mentioned above can be used for this 3rd image pick-up means 201. And 
the image according to liking of a covering person can be displayed by changing 
suitably the image by CCD camera 3, and the image by this 2nd image pick-up 
means 201, and displaying on a display unit 5. 

[0058] Drawing 1 1 is used and explained to the 4th operation gestalt pan about the 
4th operation gestalt of this invention. The head mount display 300 concerning this 
operation gestalt isolates and establishes CCD camera 3 and a driving means 7 from 
a body 301 , and it is made to picturize or drive these by remote operation, as shown 
in this drawing. 

[0059] That is, while the display unit 5 and the detection means 6 which were 
mentioned above are attached in the body 301 which is a fixed means in one and 
these means are fixed in one near a covering person's eyeball, it attaches in a self- 
propelled means 302 by which CCD camera 3 and the driving means 7 were able to 
be established separately independently [ a body 301 ]. 

[0060] A covering person is managed by remote operation and this self-propelled 
means 302 transmits the image picturized by the image pick-up means 3 attached in 
this. In addition, in this operation gestalt, this self-propelled means 302 is equipped 
with the wide angle camera 303 attached in that upper part rotatable, and it is 
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constituted so that the image which caught the large area by this, and the image 
which followed in the direction of a look of the covering person by CCD camera 3 can 
be changed suitably. 

[0061] According to the head mount display 300 concerning such 4th operation 
gestalt, since the image pick-up location by CCD camera 3 and the display position 
by the display unit 5 can be isolated, a covering person can see the image of a 
different location from the location in which a covering person is present. Since it 
picturizes by following CCD camera 3 in a covering person's direction of a look at this 
time, in the narrow location which human being cannot enter according to this head 
mount display 300, and a dangerous location, the image which was rich in the sense 
of reality can be picturized. 
[0062] 

[Effect of the Invention] According to the image pick-up equipment of this invention, 
as explained above, conversion of the image pick-up direction in the image pick-up 
equipment of a head mount display format can be made quicker and comfortable, 
and while being able to picturize the image which was rich in the sense of reality, the 
fatigue at the time of wearing can be reduced. 



TECHNICAL FIELD 



[Field of the Invention] This invention picturizes the visual field range of a covering 
person, relates to the image pick-up equipment constituted so that image formation 
of the image might be carried out on a covering person's retina, and relates to the 
head mount display with which it equips in order to amend visual disturbance, such 
as dysopsia and color amblyopia, especially. 



PRIOR ART 



[Description of the Prior Art] The head mount display format is developed as 



equipment which amends visual disturbance, such as the former, for example, the 
dysopsia, and color amblyopia. Drawing 12 is the top view showing the head mount 
display 1 10 for the conventional visual disturbance amendment. 
[0003] A head mount display 110 consists of CCD camera 113 which picturizes the 
covering person's 1 1 1 visual field field 1 12, a finder 115 which carries out image 
formation of the image picturized by this CCD camera 1 13 on the covering person's 
1 1 1 retina 114, and a body 1 16 for fixing each of these equipments to the covering 
person's 1 1 1 head in one in this drawing. 

[0004] If it explains in full detail, CCD camera 113 picturizes the field 117 equivalent 
to the covering person's 1 1 1 visual field field 112, and after being amended, it will 
project with a color LCD 1 18, it will be reflected by the mirror 119, and it will project 
the picturized image on the finder 1 15 by which opposite arrangement was carried 
out at the covering person's 1 1 1 retina 114. 



EFFECT OF THE INVENTION 



[Effect of the Invention] According to the image pick-up equipment of this invention, 
as explained above, conversion of the image pick-up direction in the image pick-up 
equipment of a head mount display format can be made quicker and comfortable, 
and while being able to picturize the image which was rich in the sense of reality, the 
fatigue at the time of wearing can be reduced. 



EFFECT OF THE INVENTION 



[Effect of the Invention] According to the image pick-up equipment of this invention, 
as explained above, conversion of the image pick-up direction in the image pick-up 
equipment of a head mount display format can be made quicker and comfortable, 
and while being able to picturize the image which was rich in the sense of reality, the 
fatigue at the time of wearing can be reduced. 
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MEANS 



[Means for Solving the Problem] In order to attain the above-mentioned technical 
problem, invention concerning this application claim 1 becomes from an image pick- 
up means picturize a covering person's visual field field, an image-display means 
carry out the image formation of the image picturized by this image pick-up means 
on said covering person's retina, a detection means detect said covering person's 
direction of a look, and the driving means that make the image pick-up direction of 
said image pick-up means follow in said direction of a look detected by said detection 
means. 

[0009] Since according to invention concerning such a claim 1 a covering person's 
direction of a look is detected and the image pick-up direction of an image pick-up 
means is made to follow in the direction of a look, even if a covering person does not 
change the direction of the whole equipment, he can project on an image display 
means the direction for which it asks. 

[0010] Invention concerning claim 2 has a maintenance means to hold said image 
pick-up means, said image display means, said detection means, and said driving 
means near said covering person's eyeball in one, in invention concerning claim 1. 
[0011] Since it can equip with each means to constitute image pick-up equipment, in 
one according to invention concerning such a claim 2, the attachment and 
detachment become easy. 

[0012] Invention concerning claim 3 has an image core migration means to move the 
core of an image that said image display means was picturized by said image pick- 
up means in a covering person's direction of a look, in image pick-up equipment 
according to claim 1 or 2. 

[0013] When according to invention concerning such a claim 3 it follows in a covering 
person's direction of a look and the image pick-up direction of an image pick-up 
means is changed by moving the core of the image displayed by the image display 
means in a covering person's direction of a look, it can prevent a gap arising in the 
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object which the covering person is observing, and the object displayed on an image 
display means. 

[0014] Invention concerning claim 4 has an assignment means to specify the 
photographic subject displayed on said image display means, and a notice means of 
a color to tell the color of this photographic subject specified by this assignment 
means, in image pick-up equipment according to claim 1, 2, or 3. 
[0015] According to invention concerning such a claim 4, even if a covering person 
has visual disturbance, such as color amblyopia, the color of the picturized object 
can be recognized easily. 
[0016] 

[Embodiment of the Invention] The 1st operation gestalt of this invention is explained 
below to the 1st operation gestalt at a detail. Drawing 1 shows typically the internal 
configuration of the head mount display 100 in this operation gestalt, and drawing 2 
R> 2 and drawing 3 are the perspective views showing the appearance. 
[0017] In drawing 1 thru/or drawing 3 a head mount display 100 CCD cameras 3 and 
3 which picturize the covering person's 1 visual field field 2, and the display units 5 
and 5 which carry out image formation of the image picturized by these CCD 
cameras 3 and 3 on the covering person's 1 retina 4a, It consists of detection means 
6 and 6 to detect the covering person's 1 direction of a look, and driving means 7 
and 7 which make the image pick-up direction of CCD cameras 3 and 3 follow in the 
direction of a look detected by the detection means 6 and 6. In addition, in this 
operation gestalt, these means operate according to the power source supplied from 
a power unit 9. 

[0018] CCD cameras 3 and 3 are image pick-up means to have an image pick-up 
field almost equal to the covering person's 1 visual field fields 2 and 2, and driving 
means 7 and 7 convert the image pick-up direction vertically and horizontally. And 
with this operation gestalt, these CCD cameras 3 and 3 are covered with hood 3a of 
the shape of a transparent semi-sphere while they are formed in the two front 
sections of a body 8. Moreover, the spacing is set up almost equally to spacing of 
the covering person's 1 eyeballs 4 and 4, and these two CCD cameras 3 and 3 are 
arranged so that the direction of a look and the image pick-up direction of the 
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covering person 1 may be in agreement. In addition, a spacing adjustment means 
may be formed in CCD cameras 3 and 3 in order to make spacing of the covering 
person's 1 eyeballs 4 and 4 suit about spacing of these CCD cameras 3 and 3. 
[0019] Display units 5 and 5 consist of a finder 57 arranged so that the back light 51 , 
the color LCD 52 and focus control 53 which were built in the flank of a body 8, the 
reflecting mirror 54 arranged on the optical axis of a focus 53, a lens 56 and a 
reflecting mirror 55, and the covering person's 1 eyeball 4 may be countered. 
[0020] By these display units 5 and 5, the image picturized with CCD camera 3 is 
displayed on a finder 57 through a reflecting mirror 54, a lens 56, and a reflecting 
mirror 55, after projecting with the back light 51 and the color LCD 52 and adjusting a 
focus etc. with focus control 53. 

[0021] A well-known technique can be used as detection means 6 and 6. The thing 
of a method which used infrared radiation is adopted with this operation gestalt. 
Drawing 4 explains more the detection means 6 and 6 concerning this operation 
gestalt to a detail. 

[0022] As shown in drawing 4 (a) thru/or (c), the detection means 6 and 6 irradiate 
infrared light at an eyeball 4 from the sources 60X and 60Y of infrared light by which 
contiguity arrangement was carried out at the eyeball 4, receive the reflected light by 
optoelectric transducers 61 R, 61 L, 61 U, and 61 D, and detect migration to dark-eyed 
right and left and the dark-eyed upper and lower sides. 

[0023] If it explains in full detail, the optoelectric transducers 61 R and 61 L which 
detect the movement toward dark-eyed right and left will be arranged so that the 
reflected light from dark-eyed right-hand side and left-hand side may be received, 
respectively, after the iris of the eye has turned to the transverse plane, and the 
output will be amplified with amplifier 63. Moreover, both the optoelectric transducers 
61 U and 61 D that detect a motion of the dark-eyed vertical direction are arranged so 
that the reflected light from the dark-eyed bottom location of slant may be received, 
after the iris of the eye has turned to the transverse plane, and the output is amplified 
with amplifier 62. And the output from amplifier 62 and 63 is analyzed by the analysis 
circuit (not shown), and the covering person's 1 direction of a look is specified. 
[0024] Driving means 7 and 7 make the upper and lower sides and right and left 
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rotate CCD cameras 3 and 3 so that they may make the image pick-up direction of 
CCD cameras 3 and 3 follow in the covering persons 1 direction of a look detected 
by the above-mentioned detection means 6 and 6. The concrete configuration of 
these driving means 7 and 7 is shown in drawing 5 and drawing 6 . In addition, 
drawing 5 R> 5 is the perspective view of a driving means 7, drawing 6 (a) shows the 
idle state of a driving means 7, and this drawing (b) shows the rotation condition. 
[0025] as shown in drawing 5 and drawing 6 (a), CCD camera 3 protrudes on the 
cube-like pedestal 70 - having -- **** -- this pedestal 70 level shaft 70a an inner 
flame 71 -- receiving -- the upper and lower sides -- it is attached rotatable. Moreover, 
the motor 73 is formed in the pedestal 70, vertical rotation is carried out to an inner 
flame 71 by this, and this vertical rotation is braked by the brake mechanism 75. 
[0026] A brake mechanism 75 consists of pan spring 75c which forces on a pedestal 
70 side permanent magnet 75a which was inserted in level shaft 70a and fixed to the 
pedestal 70 side, electromagnet 75b by which opposite arrangement is carried out so 
that it may be inserted in level shaft 70a possible [ a slide ] and may oppose 
magnetically to permanent magnet 75a, and this electromagnet 75b. 
[0027] And in order to rotate a pedestal 70 up and down, energize to electromagnet 
75b and this is made to repel magnetically to permanent magnet 75a, electromagnet 
75b is made to isolate from permanent magnet 75a, a brake is taken off, and it is 
made to rotate by the motor 73, as shown in drawing 6 (b). If the energization to 
electromagnet 75b is disconnected, magnetic repulsion will be lost, electromagnet 
75b is forced on permanent magnet 75a by the elastic force of pan spring 75c, and 
rotation of a pedestal 70 is braked. 

[0028] moreover, the inner flame 71 - a pedestal 70 -- the same -- perpendicular 
shaft 71a - an outer flame 72 - receiving - right and left -- it is attached rotatable. 
Furthermore, the motor 74 is formed also in this inner flame 71 , and thereby, while 
rotating an inner flame 71 right and left to an outer flame 72, that rotation is 
controlled by the brake mechanism 75 and the brake mechanism 76 equipped with 
the same configuration. 

[0029] Moreover, with this operation gestalt, these CCD cameras 3 and 3, display 
units 5 and 5, the detection means 6 and 6, and driving means 7 and 7 are held near 
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the covering person's 1 eyeball 4 in one at the body 8. 

[0030] In order to hold this on the covering person's 1 head, the fixed belts 81 and 83 
are formed in this body 8. The fixed belt 81 fixes a body 8 in the covering person's 1 
upper head, and the fixed belt 83 fixes a body 8 in the covering person's 1 regio 
occipitalis capitis. Moreover, the dial-type adjusters 81a and 83a which perform 
bolting adjustment of this are formed in these fixed belts 81 and 83. 
[0031] Since according to the head mount display 100 concerning such this 
operation gestalt the covering person's 1 direction of a look can be detected and the 
image pick-up direction of CCD cameras 3 and 3 can be made to follow in the 
direction of a look, even if the covering person 1 does not change the direction of the 
whole equipment, he can project on a display unit 5 the direction for which it asks. 
[0032] Moreover, with this operation gestalt, since [ which makes almost equal 
spacing of CCD cameras 3 and 3, and spacing of the covering person's 1 eyeballs 4 
and 4 ] it was prepared, it should be more rich in the sense of reality in the image 
displayed by display units 5 and 5. 

[0033] Furthermore, with this operation gestalt, in order to attach in a body 8 in one 
each means to constitute a head mount display device 100, attachment and 
detachment of this become easy. 

[0034] The 2nd operation gestalt of this invention is explained below to the 2nd 
operation gestalt at a detail. With this operation gestalt, the means of displaying of 
the image projected on the display unit 5 in the 1st operation gestalt mentioned 
above is explained in full detail. In addition, the configuration of the whole head 
mount display concerning this 2nd operation gestalt is the same as that of the head 
mount display 100 in the 1st operation gestalt mentioned above. 
[0035] And especially the display unit concerning this 2nd operation gestalt has an 
image core migration means (not shown) to move the core of the image picturized by 
CCD cameras 3 and 3 in the covering person's 1 direction of a look. 
[0036] This image core migration means is an operation means to process the image 
projected on a display unit 5 in this operation gestalt, and CPU built in a body 8 can 
realize this operation means. 

[0037] Processing of the image by this image core migration means is explained with 
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reference to drawing 7 below. In addition, drawing 7 shows the image pick-up image 
by CCD camera 3, and the display image by the display unit 5. 
[0038] Now, as shown in drawing 7 (a), CCD camera 3 has caught the cylinder 701 
in this side at the core of an image. As shown in drawing 7 (b), while the cylinder 701 
has projected on the finder 57 of a display unit 5 at the core at this time, the covering 
person 1 is observing the core P1 of a finder 57. 

[0039] And as shown in this drawing (b), suppose that the direction of a look was 
moved to P2 that the covering person 1 should observe the cube 702 which is back. 
Then, the detection means 6 detects change of a covering person's direction of a 
look, and changes the image pick-up direction of CCD camera 3 by the driving 
means 7. 

[0040] Change of the image pick-up direction of CCD camera 3 catches a cube 702 
at the core of CCD camera 3, as shown in drawing 7 (c). According to this, as shown 
in drawing 7 (d), in a finder 57, a cube 702 will project on the core P1 of an image, 
and a gap will arise from P2 which the covering person is observing. 
[0041] Under the present circumstances, an image core migration means processes 
the image which computes and displays the variation rate from the core P1 of a 
display image to the attention part P2. That is, as shown in drawing 7 (e), the core 
P1 of a display image is moved to the location of P2, and it is made in agreement 
with P2 location where a covering person observes the object which CCD camera 3 
has caught at the core. 

[0042] In addition, although the order to which the core of a display image is moved 
that this should be amended explained after the gap arose between P1 and P2 for 
convenience in this operation gestalt If a display image is processed into detecting 
change of the covering person's 1 direction of a look, and changing the image pick- 
up direction, and coincidence and the core of a display image is moved [ the drive of 
a driving means 7 ] A display object can be smoothly projected in a covering 
person's direction of a look, and it can avoid giving the covering person 1 displeasure. 
[0043] In order to move the core P1 of the image displayed on a display unit 5 in a 
covering person's direction P2 of a look according to the head mount display 
concerning the 2nd [ this ] operation gestalt which has such an image core migration 
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means, when it follows in a covering person's direction of a look and the image pick- 
up direction of CCD camera 3 changes, it can prevent a gap arising between the 
objects displayed on the point which the covering person notes, and an image- 
display means. 

[0044] In addition, in this operation gestalt, as a migration means based on images, 
although the image was processed with the operation means, this invention is not 
limited to this. For example, consider the finder 57 of a display unit 5 as a movable 
configuration vertically and horizontally, it is made to follow in a covering person's 
direction of a look, and the location of a finder 57 may be made to change. 
[0045] Moreover, the display units 5 and 5 concerning this 2nd operation gestalt 
have an image amendment means to emphasize and display the profile of the 
picturized photographic subject. This image amendment means is realizable with 
arithmetic units, such as CPU which it had for example, in the body 8. 
[0046] What emphasizes the profile of a photographic subject is employable by 
emphasizing the contrast of the image picturized, for example with CCD camera 3 as 
a method of this image amendment, reversing a hue, or extracting the profile of a 
photographic subject. 

[0047] in addition, as an approach of extracting the profile of a photographic subject 
for example, the thing for which the difference of the newly picturized image and the 
image picturized before the predetermined period (for example, one-frame period) is 
taken - or By memorizing the background image beforehand and taking the 
difference of this and an input image, a part with the motion in an image can be 
specified and the approach of processing noise rejection, labeling, a feature 
extraction, etc. to this can be used. 

[0048] Furthermore, the head mount display concerning this 2nd operation gestalt is 
equipped with a notice means of a color to tell the color of the photographic subject 
projected on the display unit 5. It notifies the analyzed color by displaying an 
alphabetic character etc. on the display means 5 like "RED" while this notice means 
of a color detects the covering person's 1 direction P3 of a look with the detection 
means 6, specifies the photographic subject 801 which the covering person 1 is 
observing and specifically analyzes that color, as shown in drawing 8 (a). 
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[0049] In addition, as an approach of notifying a covering person of this color, it 
displays in an alphabetic character etc. as mentioned above, and also the 
loudspeaker (not shown) built into the body 8, for example can also notify with voice. 
[0050] Moreover, although assignment of a photographic subject that he wanted to 
identify a color was performed with this operation gestalt by detecting a covering 
person's direction of a look with the detection means 6, this invention is not limited to 
this and can also be manually specified using pointer equipment 90 as shown in 
drawing 8 (b). 

[0051] That is, by [ to which it pinches and 91 is moved vertically and horizontally ] 
having been prepared, for example in the upper part of the grip 93 of pointer 
equipment 90, the point P3 projected on the finder 57 of a display unit 5 is moved on 
the photographic subject 801 of arbitration, by pushing a switch 92, it acts as Locke 
of the point P3, the color of the photographic subject is analyzed, and an alphabetic 
character, voice, etc. can notify a color. 

[0052] As an example for realizing such a function, a circuit block as shown in 
drawing 9 is explained. 

[0053] After separating the color of the output from CCD camera 3 as an image pick- 
up means three times, each signal of R, G, and B which were changed into the 
digital signal with A/D converters 94, 94, and 94 is supplied to level circuits 95, 95, 
and 95, respectively. And by supplying a control section 96, each signal level is 
compared and the output of level circuits 95, 95, and 95 can recognize the color 
information on a photographic subject with voice by making the result pronounce 
from a loudspeaker 99 through amplifier 98 through an electronic speech circuit 97 if 
needed. Moreover, it is also possible to also pronounce information, such as a 
condition of a photographic subject, suitably. 

[0054] After the output from a control section 96 is changed into a predetermined 
character code by the character code transducer 100 for outputting the recognized 
color information as text as text information on the other hand, it is changed into a 
predetermined pattern alphabetic character by the transducer 101, and is outputted 
to a display unit 5. 

[0055] According to the head mount display device equipped with such a notice 
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means of a color, the failure is suppliable even if a covering person has visual 
disturbance, such as color amblyopia. 

[0056] The 3rd operation gestalt, next the 3rd operation gestalt of this invention are 
explained with reference to drawing 10 . As shown in this drawing, the head mount 
display 200 concerning this operation gestalt forms the 3rd image pick-up means 201 
in the anterior part of the body 8 in the head mount display 100 in the 1st operation 
gestalt mentioned above. 

[0057] The wide angle camera which can photo a large area rather than CCD 
camera 3 mentioned above can be used for this 3rd image pick-up means 201. And 
the image according to liking of a covering person can be displayed by changing 
suitably the image by CCD camera 3, and the image by this 2nd image pick-up 
means 201, and displaying on a display unit 5. 

[0058] Drawing 1 1 is used and explained to the 4th operation gestalt pan about the 
4th operation gestalt of this invention. The head mount display 300 concerning this 
operation gestalt isolates and establishes CCD camera 3 and a driving means 7 from 
a body 301 , and it is made to picturize or drive these by remote operation, as shown 
in this drawing. 

[0059] That is, while the display unit 5 and the detection means 6 which were 
mentioned above are attached in the body 301 which is a fixed means in one and 
these means are fixed in one near a covering person's eyeball, it attaches in a self- 
propelled means 302 by which CCD camera 3 and the driving means 7 were able to 
be established separately independently [ a body 301 ]. 

[0060] A covering person is managed by remote operation and this self-propelled 
means 302 transmits the image picturized by the image pick-up means 3 attached in 
this. In addition, in this operation gestalt, this self-propelled means 302 is equipped 
with the wide angle camera 303 attached in that upper part rotatable, and it is 
constituted so that the image which caught the large area by this, and the image 
which followed in the direction of a look of the covering person by CCD camera 3 can 
be changed suitably. 

[0061] According to the head mount display 300 concerning such 4th operation 
gestalt, since the image pick-up location by CCD camera 3 and the display position 
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by the display unit 5 can be isolated, a covering person can see the image of a 
different location from the location in which a covering person is present. Since it 
picturizes by following CCD camera 3 in a covering person's direction of a look at this 
time, in the narrow location which human being cannot enter according to this head 
mount display 300, and a dangerous location, the image which was rich in the sense 
of reality can be picturized. 
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[Brief Description of the Drawings] 

[Drawing 1] The top view of the head mount display concerning the 1st operation 
gestalt of this invention is shown. 

[Drawing 2] It is the perspective view showing the appearance of the head mount 
display in the 1st operation gestalt. 

[Drawing 3] It is the perspective view showing the appearance of the head mount 
display in the 1st operation gestalt. 

[Drawing 4] It is the explanatory view showing the principle of the detection 
equipment in the head mount display concerning the 2nd operation gestalt of this 
invention. 

[Drawing 5] It is the perspective view expanding and showing the image pick-up 
means in the head mount display concerning the 2nd operation gestalt of this 
invention, 

[Drawing 6] It is the explanatory view showing the drive principle of the image pick-up 
means in the head mount display concerning the 2nd operation gestalt of this 
invention, and a driving means. 

[Drawing 7] It is the explanatory view showing the drive principle of the image display 
means in the head mount display concerning the 2nd operation gestalt of this 
invention. 

[Drawing 8] It is the explanatory view of the notice means of a color in the head 

mount display concerning the 2nd operation gestalt of this invention. 

[Drawing 9] It is a circuit block diagram for realizing the function of the notice means 
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of a color in the head mount display concerning the 2nd operation gestalt of this 
invention. 

[Drawing 10] The top view of the head mount display concerning the 3rd operation 
gestalt of this invention is shown. 

[Drawing 11] The top view of the head mount display concerning the 4th operation 
gestalt of this invention is shown. 

[Drawing 12] It is drawing showing the conventional head mount display. 
[Description of Notations] 

1 Covering Person 

2 Visual Field Range 

3 CCD Camera (Image Pick-up Means) 

4 Eyeball 
4a Retina 

5 Display Unit (Image Display Means) 

6 Detection Means 

7 Driving Means 

8 Body 

9 Power Unit 

100 Head Mount Display 
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